Control of chaos in Hamiltonian systems 
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We present a technique to control chaos in Hamiltonian systems which are close to integrable. By 
adding a small and simple control term to the perturbation, the system becomes more regular than 
the original one. We apply this technique to a forced pendulum model and show numerically that 
^ ■ the control is able to drastically reduced chaos. 



I. INTRODUCTION 



In this article, the problem we address is how to control chaos in Hamiltonian systems which are close to integrable. 
, We consider the class of Hamiltonian systems that can be written in the form H — Hq + eV that is an integrable 
Hamiltonian Hq (with action-angle variables) plus a small perturbation eV. 

The problem of control in Hamiltonian systems is the following one: For the perturbed Hamiltonian Hq + eV , the 
aim is to devise a control term / such that the dynamics of the controlled Hamiltonian Hq + eV + f has more regular 
trajectories (e.g. on invariant tori) or less diffusion than the uncontrolled one. In practice, we do not require that the 
controlled Hamiltonian is integrable since it is a too strong requirement, but only that it has a more regular behavior 
than the original system. 

" ' , Obviously / = —eV is a solution since the resulting Hamiltonian is integrable. However, it is a useless solution since 

■ the control is of the same order as the perturbation. 

o ■ 

■ For practical purposes, the desired control term should be small (with respect to the perturbation eV), localized 
T-H [ in phase space (meaning that the subset of phase space where / is non-zero is finite or small enough), or / 

should be of a specific shape (e.g. a sum of given Fourier modes, or with a certain regularity). Moreover, the 
' control should be as simple as possible in order to be implemented in experiments. Therefore, the control appears 
to be a trade-off between the requirement on the reduction of chaos and the requirement on the simplicity of the control. 



In this article, we provide an algorithm for finding a control term / of order O(e^) such that H = Hq -f -I- / is 
Ch integrable. This control term is expressed as a series whose terms can be explicitly and easily computed by recursion. 
^ It is shown on an example that truncations and approximations of this control term / provides a simple and easy 
way to control the system. 



II. CONTROL THEORY OF HAMILTONIAN SYSTEMS. 

In this section, we follow the exposition of control theory developed in Ref. _8|. Let A be the algebra of real functions 
defined on phase space. For H E A, let {H} be the linear operator acting on A such that 

{H}H' = {H,H'}, 

for any H' e A, where {• , •} is the Poisson bracket. The time-evolution of a function V E A following the flow of H 
is given by 

which is formally solved as 

V{t) = e*^^>F(0), 
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if H is time independent, and where 



n< 

n=Q 

Any element V E A such that {H}V — 0, is constant under the flow of H, i.e. 

Let us now fix a Hamiltonian Hq G The vector space KerjiJo} is the set of constants of motion and it is a 
sub- algebra of A. The operator {Hq} is not invertible since a derivation has always a non-trivial kernel. For instance 
{Hq}{Hq°') = for any a such that Hq"' E A. Hence we consider a pseudo-inverse of {Hq}. We define a linear 
operator F on A such that 

{HoV r = {i/o}, (1) 

i.e. 

yVEA, {Ho,{Ho,TV}} = {Ho,V}. 

If the operator F exists, it is not unique in general. Any other choice F' satisfies Rg(F' — F) e Ker({Ho}^). 
We define the non-resonant operator J\f and the resonant operator TZ as 

^f = {Ho}r, 
n = i-M, 

where the operator 1 is the identity in the algebra of linear operators acting on A. We notice that Eq. becomes 

{i^o}7^ - 0, 

which means that the range RgT?. of the operator TZ is included in KerjiJo}- A consequence is that any element TZV 
is constant under the flow of H^, i.e. e^^^°^TZV — TZV. We notice that when {Hq} and F commute, TZ and A/" are 
projectors, i.e. TZ"^ = TZ and Af^ — Af. Moreover, in this case we have KgTZ — KerjiJo}, i-C. the constant of motion 
are the elements TZV where V E A. 

Let us now assume that Hq is integrable with action-angle variables (A, (p) E B x T" where B is an open set of M" 
and T" is the n-dimensional torus, so that Hq = Hq{A) and the Poisson bracket {H,H'} between two Hamiltonians 
is 

dH dH' dH dH' 

{H,H I 



dA dip dip dA 



The operator {Hq} acts on V given by 



V^J2 ^k(A)e'''-^, 



as 



{Hq}V{A, ip)^Yl *'^(^) • ^ ^k(A)e* '^, 

k 

where the frequency vector is given by 

a;(A) 



OA 

A possible choice of F is 



iu:(A) ■ k 
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We notice that this choice of F commutes with {-ffo}- 

For a given V G A, TZV is the resonant part of V and AfV is the non-resonant part: 

W = 5]T/k(A)x(c^(A).k-0)e^''-^, (2) 

k 

AAl/ = ^VL(A)x(u;(A).k^O)e'^''-^, (3) 

k 

where xi^^) vanishes when proposition a is wrong and it is equal to 1 when a is true. 

From these operators defined for the integrable part Hq, we construct a control term for the perturbed Hamiltonian 
Hq + V where V £ A, i.e. we construct / such that Hq + V" + / is canonically conjugate to Hq + TZV. 

Proposition 1: For V £ A and F constructed from Hq, we have the following equation 

e{r^> (iJo + 1/ + /) = i^o + W, (4) 

where 

1 - p-{^^} 

f{V) = e-ii^^> W + ^^^^ MV V. (5) 
We notice that the operator (1 — e^^^^^) / {TV} is well defined by the expansion 

We can expand the control term in power series as 

n— 1 ^ 

We notice that if V is of order e, /(y) is of order e^. 

Proposition 1 tells that the addition of a well chosen control term / makes the Hamiltonian canonically conjugate 

to Hq + nv. 

Proposition 2 : The fiow of Hq + y + / is conjugate to the flow of Hq + TZV: 

Vt e M, e^^o+^+Z} = e-{r^} e*{Ho} ^t{TZV} ^{vv] ^ 

The remarkable fact is that the flow of TZV commutes with the one of Hq, since {Hq}TZ = 0. This allows the 
splitting of the flow of Hq + TZV into a product. 

We recall that Hq is non-resonant iff 

VAeS, x(^(A)-k = 0) = x(k = O). 

If Hq is non-resonant then with the addition of a control term /, the Hamiltonian Hq + V + f is canonically conjugate 
to the integrable Hamiltonian Hq + TZV since TZV is only a function of the actions [see Eq. (0)]. 

If Hq is resonant and TZV — 0, the controlled Hamiltonian H = Hq -|- F -|- / is conjugate to Hq. 
In the case TZV = 0, the series © which gives the expansion of the control term /, can be written as 



s=2 



where fs is of order and given by the recursion formula 



fs^-l{rv,fs-i}, (8) 



where fi = V . 
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Remark : A similar approach of control has been developed by G. Gallavotti in Refs. The idea is to find a 

control term (named counterterm) only depending on the actions, i.e. to find N such that 

H{A, if) = Ho{A) + V{A, if) - N{A) 

is integrable. For isochronous systems, that is 

HoiA) ^LJ-A 

it is shown that if the frequency vector satisfies a Diophantine condition and if the perturbation is sufficiently small 
and smooth, such a control term exists, and that an algorithm to compute it by recursion is provided by the proof. 
We notice that the resulting control term N is of the same order as the perturbation. 

III. APPLICATION TO A FORCED PENDULUM MODEL 

We consider the following model with 1.5 degrees of freedom 

H{p, X, t) — + e [cos X + cos{x — t)] . (9) 

Figure n] depicts a Poincare section of Hamiltonian Q for e — 0.034. We notice that for e > 0.02759 there are no 
longer any KAM tori . In order to apply the control theory described above, we need to put Hamiltonian ^ in an 




FIG. 1: Poincare surface of section of Hamiltonian Q with e = 0.034. 

autonomous form. We consider that t is an additional angle whose conjugate action is E. The Hamiltonian becomes 
autonomous 

H{p, X, E,t) = ^p^ + E + e [cos x + cos{x - t)] , (10) 

where the actions are A = {p, E) and the angles are if = {x,t). The unperturbed Hamiltonian that will be used to 
construct the operators F, TZ and JV is 

Ho{p,E)^^p^ + E. (11) 
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The action of {-ffo}, T, TZ and Af on functions V € A given by 



i(kix+k2t) 



ki ,fc2 



^i{kix+k2t) 



fcl,fc2GZ 

The action of these operators on t) — e [cos a; + cos(a; — t)] is 

{i/ojV' = — £ [psin.T + {p — I) sin(x — i)] 

ry ~ e — sin a; H sin(a; — i) 

P P-1 
W 0, 

AfV = V = e [cos a; + cos(x — t)] , 

for p 7^ 0, 1. Since 7?.T^ = 0, the control term is given by Eq. and the terms in the series are computed by recursion. 
In particular, the first term /2 is given by 

1 1 dVV dV 

since V is independent of p. The explicit expression of /2 is given by 

— ^ cos 2a: + , 

4 \p^ [p-l] 

1 1 



f2ip,x,t)= — (— cos2a:+ _ cos2(a:-t) 



4 (p - 1) 



(l + cosi-cos(2a;-t)). (12) 



The main purpose of the control is to have a control term which is as simple as possible in order to be implemented 
in the experiment. 

A possible simplification is to consider the region in between the two primary resonances located around p — and 
p = I. We develop the approximate control term around p = 1/2. It thus becomes 

f2{p,x,t) = (cos2x + cos2(x — i) + 2cos(2a; — t)) , 

up to a function that only depends on time. Furthermore, we only keep the main Fourier mode of this control term. In 
the region p ~ 1/2 the two terms cos 2a; and cos2(x — t) which are associated with resonances approximately located 
at p = and p = 1 have a much smaller influence than the term cos(2x — t) which is associated with a resonance 
located aX p — 1/2. The control term we study is thus 

/2(p,a:,t) = 2e2cos(2a; - t). (13) 

Figure 121 depicts a Poincare section of the Hamiltonian with the approximate control term for the same value 
of e used in Fig.^ i.e. e = 0.034. It clearly shows that a lot of KAM tori are created with the addition of the control 
term. We notice that the perturbation has a norm (defined as the maximum of its amplitude) of 6.8 x 10^^ whereas 
the control term has a norm of 2.3 x lO^'' for e = 0.034. The control term is small (less than 4% ) compared to the 
perturbation . 

We can decrease the amplitude of the control term by considering 

/2(p, a;, t) = ae^ cos(2a; — t). 
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FIG. 2: Poincare surface of section of Hamiltonian Q with the approximate control term 113^ with e = 0.034. 

where a < 2 and still get a lot of KAM tori in the vicinity of the region p — 1/2. For instance, the control is still 
effective with a = 0.8. Using the renormalization-group transformation we have looked at the domain of existence 
of the golden-mean KAM torus which is the rotational invariant torus with frequency (3 — \/5)/2. This rotational 
invariant torus only exists in the domain 

a e [0.778,3.173]. 

Therefore, in this domain of a there are barriers in phase space that prevent diffusion of trajectories. The control is 
optimal for a — 2. Increasing the amplitude of the control does not improve the control which means that the control 
we devised is not "brute force". This control is robust since it is effective away from its reference value a — 2. There 
is also the possibility of reducing the control (by a factor larger than 2) and still get a significant effect of the control. 
In order to see more precisely the effect of the control term, we have applied Laskar's Frequency Map Analysis (Tjj to 
this model. For initial conditions {x,p) where x = and p € [0.15,0.5], we compute the main (rotational) frequency 
U!{p) of the trajectory integrated from to T = 2.5 x 10'^ following Laskar's procedure. Figure O depicts the frequency 
a; as a function of p for Hamiltonian with e — 0.034 with and without the addition of the approximate control 
term (I13II . An apparent continuous variation of the frequency is associated with a region with KAM tori. A flat 
variation is associated with a resonant island. A scatter of points is associated with a chaotic region. 
Without control term, the region located between the stable regions of the resonances 1:4 and 1:2 is chaotic and does 
not contain any KAM tori since the frequency map does not show continuous regions. With control term, we clearly 
see that the frequency curve appears to be continuous and hence the region contains a lot of KAM tori. 

IV. CONCLUSION 

We have shown on a simple example the explicit construction of a control term. This term can be drastically 
simplified and still is able to reduce chaos in the system. The idea is to have a control term as simple as possible in 
order to be implemented in experiment. We notice that this approach has been applied to a model of transport for 
the E X B drift 0,13- K has been shown that the control drastically reduces the chaotic transport in this model. 
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FIG. 3: Frequency analysis of Hamiltonian ||5J with e = 0.034 (a)without control term and (b) with control term (I13I I. The 
fundamental frequency u;{p) is plotted versus p for p G [0.15, 0.45] for the trajectories with initial conditions {x = 0,p). 
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